Dec 22
14
Gary Illyes from Google said on LinkedIn that if your server returns a 500/503 HTTP status code for an extended period of time for your robots.txt file, then Google may remove your site completely from Google Search.
Read the original here:
500/503 HTTP Status Code On Robots.txt Can Remove Your Site From Google Search